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Executive Summary 



The Alberta Initiative for School Improvement (AISI) was developed through a collaborative 
partnership in 1999 and first implemented in all Alberta school authorities in the 2000/2001 
school year. The goal of this program is to improve student learning and performance by 
fostering initiatives that reflect the unique needs and circumstances of each school authority. 
AISI provides $68 million targeted funding annually to school authorities for specific local 
improvement projects. Initially allocated for three years from 2000 to 2003, funding has been 
extended for a second three-year cycle from 2003 to 2006. The Alberta Government invested 
$204 million dollars in support of school improvement projects during Cycle 1 of AISI. 

Cycle 1 achieved the Minister’s 1999 expected outcomes. 

1 . It developed a program that contributes to improved student learning and performance. 

2. It established a foundation of trust between government and education stakeholders. 

3. It created a model for collaboration that has been employed in other government initiatives. 

4. It established accountability measures and criteria to provide evidence that the initiative is 
working. 

5. And finally, continuous improvement has become AISI’s modus operandi. 

AISI represents an effective approach that focuses on improving student learning through 
partnerships and collaboration in a culture of continuous improvement, inquiry and reflection. 
Continuous improvement is a mindset that now permeates the education community in Alberta. 



AISI Impacts 

During its initial three years of implementation, AISI has had a profound impact on the culture 

of schools in Alberta. 

1 . Improved student learning - AISI had a positive and sustained impact on student learning 
during Cycle 1. More than 90% of the projects exceeded their baseline on the majority of 
measures every year. On average over the three years, 48% of the projects improved 
student learning and 57% improved satisfaction (students, parents, and teachers). AISI 
students performed slightly better than their non- AISI counterparts on English language arts 
and mathematics on the grades 3, 6 and 9 provincial achievement tests. 

2. Culture of continuous improvement - Brain research has shown that emotion drives 

attention, learning, memory and behavior. The emotional investment demonstrated by staff 
involved with AISI projects has resulted in a renewed energy and excitement for school 
improvement. AISI promotes a culture of shared responsibility for continuous improvement 
in schools and jurisdictions that clearly align school improvement goals and classroom 
practices. Schools operating as learning communities actively engage both teachers and 
students in learning. 

3. Renewed focus on teaching and learning - There is a renewed focus on learning as the 
central purpose of schooling. Both teachers and students have benefited from this emphasis 
on continuous learning and improvement. 
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4. Innovation and creativity - AISI is unique as a province-wide, funded initiative to improve 
student learning that trusts local authorities to decide how to improve student learning by 
fostering projects that address local needs and circumstances. AISI recognizes that one size 
does not fit all, that needs vary across the province, and that there are many different ways 
to accomplish the same goal, namely, improved student learning and performance. 

5. Shared language - Teachers, students, parents and administrators are developing a 
common language of school improvement. With 90% of Alberta schools involved in an 
AISI project, the language of improvement - goals, strategies, measures, baselines, targets, 
and results - are now widely understood and used. 

6. Research in classrooms - More teachers are routinely reading the research literature and 
becoming better versed in research-based practices for improving teaching and learning. 
This openness to evidence and new ideas contributes to a culture of continuous 
improvement in schools. 

7. New knowledge - Teachers are contributing to the body of knowledge about teaching and 
learning. In many cases they are corroborating the research evidence from other places in 
the Alberta context. 

8. Evidence-based decisions - Teachers are making better informed decisions about student 
learning and instructional practices based on solid evidence collected through appropriate 
assessment strategies that include standardized tests, rubrics, observations, and teacher- 
made approaches. Schools are surveying students, parents, and staff to get their input into 
educational processes and desired outcomes. 

9. Job-embedded professional development - There is an increased emphasis on professional 
development. Schools are using a variety of professional development (PD) strategies to 
meet local needs and PD has become embedded in school improvement initiatives. School 
jurisdictions now use markedly different PD models that have evolved from one-time 
experiences to focused, collaborative and ongoing activities targeted at meeting specific 
learner needs. Self-direction and application of learnings have changed the way PD is 
offered with a renewed focus on improving student learning. 

10. Shared and distributed leadership - Staff willingness to take on leadership roles and to 
involve the school community, parents and students, where appropriate, has facilitated the 
partnerships needed to achieve school improvement in a holistic way. The partners all 
contribute to supporting school improvement at both local and provincial levels. AISI has 
contributed to widespread development of a new generation of education leaders. Many 
teachers who became AISI coordinators and team leaders went on to school and district 
leadership positions. A culture of shared/distributed leadership has become common in 
Alberta schools. 

11. Engaged parents - AISI projects have made a concerted effort to engage parents in 
meaningful ways in their children’s learning and school improvement activities. An 
effective parental involvement strategy was having children read at home with their parents; 
this strategy was found to improve student achievement. 
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Scope and Funding 

There were 828 Cycle 1 projects, the majority (74%) of which were for three years: 526 public 
and 302 private projects. AISI projects were implemented in 90% of all public and private K-12 
schools in Alberta. 

Staffing and benefits over the three years represented almost 84% of total AISI expenditures for 
over 1,000 full-time equivalent teachers, teacher assistants and AISI coordinators per year. 
Supplies and services, capital and other expenses represented about 10%, 3% and 3% 
respectively of total AISI expenditures over the three years. Approximately 17% was expended 
on professional development (substitute cost, release time, outside instructors, supplies and 
equipment) and about 5% on administrative support. 

AISI Projects 

Project statistics are based on 807 projects 1 operating in active school authorities. 

• Targeted Student Groups - Most projects included regular students (523 projects, 64.8%). 
Special-needs students were targeted in 230 projects (28.5%) and students at-risk in 178 
projects (22.1%). 

• Subjects - Literacy accounted for 34.3% and mathematics accounted for 15.6% of the 
projects. Ninety-three projects (1 1.5%) focused on all core subjects (language arts, 
mathematics, social studies, and science). Two other areas addressed were fine arts (4.1%) 
and science (4.0%). 

• Themes - The major themes were (1) capacity building [primarily through teacher 
professional development (30.5%) and the purchase of teaching and learning resources 
(29.0%)], (2) technology (17.5%), (3) early intervention (10.7%), and (4) parent/community 
involvement (10%). Professional development overlaps with most of the other themes 
indicating that it was integral to the projects. 

• Division/Grade Level - The majority of the projects were at the elementary (Kindergarten 
to grade 6) and junior high (grades 7 to 9) levels. There were fewer at the high school level 
(246 projects, 30.5%). Eight-four projects (10.4%) included students in pre-kindergarten. 

• Instructional Strategies - The most widely used teaching strategies were small groups (88 
projects, 10.9%), individual programming (64 projects, 7.9%), experiential learning (58 
projects, 7.2%), accommodating learning styles (47 projects, 5.8%), computer-assisted 
instruction (44 projects, 5.5%), and differentiated instruction (41 projects, 5.1%). 

Measures and Analysis 

The most commonly used measures were descriptions of quality (62.5%) and surveys (59.4%). 
Descriptions of quality differ from other measures in that they are narrative. Achievement tests 
were used extensively: provincial achievement tests (39.0%), standardized tests (22.9%), and 
locally developed teacher tests (14.9%). Other measures included school records (15.2%), 
observation/checklists (13.5%), and program participation (12.5%). 



1 Twenty-one private projects were discontinued because the private school or private ECS authority discontinued 
operations. Therefore, project statistics are based on the 807 projects operating in active school authorities. 
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Alberta Learning performed four types of analyses to determine project success: 

• Results that improved over the baseline. 

• Results that met or exceeded annual targets. 

• Magnitude of improvement through effect size analysis. 

• Relative effects of various project categories through meta-analysis. 



Project Effects 

• There was a gradual increase in the average annual effects on all measures indicating that 
AISI had a positive and sustained impact during Cycle 1. See Figure 1 . 

• More than 90% of all projects exceeded their baseline on the majority of measures every 
year (94%, 92%, and 91% for the three years respectively). Almost six in ten projects 
(58%) exceeded their baseline on all measures in 2001; this decreased slightly to half the 
projects in 2002 and 2003 (47% and 50% respectively). 

• The percentage of projects meeting annual targets on the majority of measures declined 
slightly over time: 8 1% in the first year, 74% in the second year, and 69% in the third year 
of AISI. Thirty-nine percent of projects met targets on all measures in the first year, 30% in 
the second year, and 28% in the third year. 



Figure 1: Average Annual Effects of AISI Cycle 1 




Differential Effects 

Meta-analysis identified differential effects for groups of students, curricular areas, themes, and 
instructional strategies. See Table 1. 
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Table 1: Summary of AISI Effects on Student Achievement and Satisfaction 



Effect Size* 


Student Groups 


Selected 

Subjects 


Selected Themes 


Instructional 

Strategies 


Student Achievement 


Medium 




• Science 
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Early 
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Reading with 


(0.4-0. 7) 








intervention 




parents at home 
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Technology 














integration 
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• At risk 


• Early 
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Transition to 
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Small groups 


(0.2-0. 3) 


• Special needs 


literacy 




high school 


• 


Counselling 




• Regular 


• Math 


• 


High school 
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Peer assistance 






• Pine arts 




completion 
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Differentiation 
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Small class size 


Minimal 


• Gifted 
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School climate/ 






(Less than 0.2) 








behavior 






Satisfaction (Students, Parents, Teachers) 


Large (0.8 +) 
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Technology 
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Reading with 








• 


School climate/ 
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behavior 
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Small class size 












• 


Differentiation 












• 


Small groups 


Small (0.2-0. 3) 


• Gifted 


• Early 


• 


Early 










literacy 




intervention 






Minimal 














(Less than 0.2) 















about 26 percentile points. 



: points, 0.4 of about 16 percentile points, and 0.7 of 



Student Achievement - Generally, student achievement improved. 

• Students who were at risk or had mild/moderate needs showed greater improvement (0.30 
and 0.28 respectively) on student achievement than those in regular (0.23) or gifted (0.10) 
programs. 

• Science projects demonstrated the largest effects (0.35) followed by early literacy (0.30). 

• Early intervention projects had the largest effects (0.43) followed by transitions to high 
school (0.34) and high school completion (0.31) projects. 

• The most effective instructional strategies were reading with parents at home (0.38), 
technology integration (0.36), small groups (0.34), counselling (0.33), and peer assistance 
(0.30). 

Satisfaction - AISI had a greater impact on satisfaction (students, parents, and teachers) than 

on student achievement, with moderate effects for most of the categories examined. 
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Provincial Achievement Tests 

Provincial achievement test results provide another way to examine the impact of AISI. All 
public and private schools were categorized as participating (AISI students) or not participating 
(non-AISI students) 2 in a literacy/language arts or mathematics project at grades 3, 6 or 9. 
Results are presented for the cohort 3 , which presents results for all students in the grade, both 
writers and non-writers. Results are reported for the acceptable standard 4 . 

• In both English Language Arts and mathematics, AISI students performed slightly better 
than their non-AISI counterparts at grades 3, 6, and 9. 

• While differences were already evident in the three years (1998-2000) before AISI, the gap 
between AISI and non-AISI students widened slightly over time. 

• Over the three years, AISI students tended to improve perfonnance slightly while non-AISI 
students tended to decrease performance slightly. 

• Grade 9 mathematics achievement is anomalous, that is, it declined over time for both 
groups of students. 



Recommendations 

The results of AISI Cycle 1 lead to a number of recommendations for all partners during Cycle 

2. Recommendations are proposed for school authorities, schools, universities, parents, 

education partners, and government. 

School Authorities 

1. School authorities should continue to focus their AISI projects on improving student 
learning and performance to address local needs and circumstances. Project focus must 
continue to be on student learning, with all other actions in support of this goal. 

2. School authorities should ensure appropriate and adequate project support through 
appointment of one or more project coordinator(s) responsible for overall coordination and 
support of each project. AISI funds should be used for coordinator time as determined by 
local needs. 

3 . School authorities should integrate what was learned during Cycle 1 into their policies, 
programs and practices. 



2 Non-AISI students are those who attended schools that did not have an AISI literacy (for math results) or math 
(for language arts results) project at grades 3, 6 or 9. This approach was used to come up with a comparison group 
since more than 90% of all K-12 schools in Alberta were involved in an AISI project during Cycle 1. 

’ The cohort essentially assumes that those who did not write would have received a score of zero. If a school has 
a high participation rate of students writing the test, achievement results are for the cohort woidd be similar to 
those of students writing. As the participation rate decreases, the cohort result declines accordingly. 

4 The acceptable standard includes the standard of excellence. A student achieving the acceptable standard shows 
an adequate understanding of the core knowledge and adequate basic skills essential to a course. A student 
achieving the standard of excellence consistently shows a deeper understanding of the concepts of a course. Few 
AISI projects used the standard of excellence as a measure. 
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4. School authorities should share what has been learned, both within the district and with 
others by posting promising practices, products and tools on the AISI Clearinghouse. 

5. School authorities should focus on the selection of relevant measures to collect data, 
comprehensive analysis and interpretation of findings, and documented evidence of success. 

6. School authorities should involve staff and parents in all phases of planning, implementation 
and analysis of results. Projects should reflect support of those who will implement them. 

7. School authorities should provide opportunity for focused and sustained staff professional 
development that focuses on improving student learning through achievement of project 
goals. This has the greatest potential for transforming practice. All staff should be 
involved in professional development that is collaborative and meaningful. 

Schools 

8. Professional learning communities foster supportive and shared leadership, collective 
creativity, shared values and vision, supportive conditions, and shared personal practice 5 . 
School-wide projects that involve all staff (in project design, implementation and evaluation 
of results) are more likely to sustain a culture of continuous improvement. 

9. Schools should plan for staff collaboration on AISI activities. Joint planning, developing 
and implementing instructional strategies, and analyzing and reporting results fosters staff 
capacity and commitment to the project. 

10. Schools should integrate what was learned during Cycle 1 into their policies, programs and 
practices. 

1 1 . School improvement plans should incorporate school-wide professional development for staff. 

12. Schools should make greater efforts to involve parents in school and their AISI projects. 
Parents are their children’s first teachers and their most important advocates. Involvement 
of parents and school councils can enhance communication between the school and home 
and contribute to improved student learning. 

Universities 

13. AISI contains a wealth of data for scholarly analysis of an innovative province-wide school 
improvement initiative. Graduate students could make aspects of AISI their thesis and 
dissertation topics. This would contribute to further in-depth analysis of AISI results and 
scholarly documentation of AISI. 

14. Faculties of Education are essential in incorporating what is learned through AISI into both 
their initial teacher preparation and graduate programs. Alberta schools have become a 
natural laboratory for educational improvement. 



5 Hord (1997). 
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15. Wherever possible, student teachers should be placed in AISI schools to learn first-hand 
about new instructional strategies and to participate in a culture of continuous improvement. 
Teachers in these schools can provide excellent coaching and mentoring for the new 
generation of prospective teachers. 

Parents 

16. Parents should actively engage in the education of their children. Parents who support their 
children in their schooling and educational aspirations increase their children’s life prospects. 

17. Parents should become involved in AISI through their schools and through their school councils. 

18. The Alberta Home and School Councils’ Association and Alberta Regional Consortia 
should provide professional development and support for parents, including knowledge 
about and involvement in AISI. 

Education Partners 

19. Education partners should continue to demonstrate leadership and work collaboratively so 
that AISI fulfils its potential. 

20. Education partners should ensure that AISI continues to focus on improving student 
learning and performance. 

21. Education partners should continue to assess AISI and to use evidence to inform 
rec ommendations . 

22. Education partners should share effective practices with their constituents. 

Government 

23. Alberta Learning should continue to ensure that AISI funding remains targeted. Government 
is demonstrating its commitment to school improvement by continued targeted funding for 
Cycle 2 of AISI. 

24. Alberta Learning should continue to enhance its staff knowledge about AISI and should 
integrate what was learned during Cycle 1 into its policies, programs and practices. 

25. Alberta Learning should use AISI evidence to inform decision making. 

26. The School Improvement Branch should continue to expand the development of the 
Clearinghouse and support the sharing of effective practices. 

27. The School Improvement Branch should continue to provide support to school authorities 
in the areas of project design, implementation, and evaluation. 
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